Robust Regression Methods For Massively Decayed Intelligence Data
نویسنده
چکیده
ROBUST REGRESSION METHODS FOR MASSIVELY DECAYED INTELLIGENCEDATA byAKIVA JOACHIM LORENZMay 2014 Advisor: Dr. Barry MarkmanMajor: Evaluation and ResearchDegree: Doctor of Philosophy Homeland Security, sponsored by governmental initiatives, has become a vibrantacademic research field. However, most efforts were placed with the recognition ofthreats (e.g. theory) and response options. Less effort was placed in the analysis of thecollected data through statistical modeling. In a field that collects more than 20terabyte of information per minute though diverse overt and covert means and indexesit for future research, understanding how different statistical models behave when itcomes to massively decayed data is of vital importance.Using Monte Carlo methods, three regression techniques (ordinary least squares,least-trimmed, and maximum likelihood) were tested against different data decaymodels presumed to be found in homeland security research studies in order to testwhether these techniques will preserve the Type I error rate in the t-test ofstandardized beta.The results of these Monte Carlo simulations (sample size n=30,90,120,240,480and 100,000 iterations) showed that the least trimmed squares method should beavoided under any circumstance due to the lack of a defined standard error, while themaximum likelihood technique should be avoided with smaller sample sizes due to theinflated Type I errors. Interestingly, although it is known that the ordinary least squares
منابع مشابه
Support vector regression for prediction of gas reservoirs permeability
Reservoir permeability is a critical parameter for characterization of the hydrocarbon reservoirs. In fact, determination of permeability is a crucial task in reserve estimation, production and development. Traditional methods for permeability prediction are well log and core data analysis which are very expensive and time-consuming. Well log data is an alternative approach for prediction of pe...
متن کاملRobust high-dimensional semiparametric regression using optimized differencing method applied to the vitamin B2 production data
Background and purpose: By evolving science, knowledge, and technology, we deal with high-dimensional data in which the number of predictors may considerably exceed the sample size. The main problems with high-dimensional data are the estimation of the coefficients and interpretation. For high-dimension problems, classical methods are not reliable because of a large number of predictor variable...
متن کاملFuzzy Robust Regression Analysis with Fuzzy Response Variable and Fuzzy Parameters Based on the Ranking of Fuzzy Sets
Robust regression is an appropriate alternative for ordinal regression when outliers exist in a given data set. If we have fuzzy observations, using ordinal regression methods can't model them; In this case, using fuzzy regression is a good method. When observations are fuzzy and there are outliers in the data sets, using robust fuzzy regression methods are appropriate alternatives....
متن کاملPrediction of chronological age based on Demirjian dental age using robust ridge regression method
Introduction: Estimation of age has an important role in legal medicine, endocrine diseases and clinical dentistry. Correspondingly, evaluation of dental development stages is more valuable than tooth erosion. In this research, the modeling of calendar age has been done using new and rich statistical methods. Considerably, it can be considering as a practicable method in medical science that is...
متن کاملRobust Estimation in Linear Regression with Molticollinearity and Sparse Models
One of the factors affecting the statistical analysis of the data is the presence of outliers. The methods which are not affected by the outliers are called robust methods. Robust regression methods are robust estimation methods of regression model parameters in the presence of outliers. Besides outliers, the linear dependency of regressor variables, which is called multicollinearity...
متن کامل